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We develop a stochastic control system from a continuous-time Principal- 
Agent model in which both the principal and the agent have imperfect infor- 
mation and different beliefs about the project. We consider the agent's prob- 
lem in this stochastic control system, i.e., we attempt to optimize the agent's 
utility function under the agent's belief. Via the corresponding Hamilton- 
Jacobi-Bellman equation the value function is shown to be jointly continu- 
ous and to satisfy the Dynamic Programming Principle. These properties 
directly lead to the conclusion that the value function is a viscosity solution 
of the HJB equation. Uniqueness is then also established. 
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1 Introduction 

Real-world principal-agent relationship such as the venture capitalist- 
entrepreneur relationship or the shareholder-manager relationship are usu- 
ally characterized by at least two components: (i) the presence of uncer- 
tainty and heterogeneous beliefs about the intrinsic qualities of the project 
in which they are involved; (ii) Different attitudes towards this project's 
risks. To investigate how heterogeneous beliefs and agency conflicts affect 
principal-agent relationship, Giat, Hackman and Subramanian [13] have de- 
veloped a dynamic structural model. In their dynamic framework, both the 
principal and the agent take action that affect the project's output, and the 
dynamic contracts between the principal and the agent are characterized as 
the principal's investment policy, the agent's effort policy and the payoffs 
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of the agent. The principal and the agent both have imperfect information 
about the project's intrinsic quality which was the main output growth per- 
period of the project's value process under a suitable probability measure. 
That is, they had different mean assessments of the normally distributed 
project quality while they agree on the variance of their respective assess- 
ments. In that framework the principal is risk-neutral while the agent is 
risk-averse (so that his/her utility function is a negative exponential) with 
inter-temporal constant absolute risk aversion (CARA). Under the optimal 
dynamic contracts between the principal and the agent (optimal in the sense 
of optimizing the agent's conditional expected utility at each date), they 
showed that the agent's pay-off process evolved as a diffusion process whose 
drift and volatility both depend on the principal's optimal investment and 
the agent's optimal effort. 

In order to provide a rigorous approach of the optimal dynamic contract 
(optimal in the sense of optimizing the agent's absolute expected utility, 
see Williams [35J), we only consider the agent's problem, in which all the 
random processes are distributed under the agent's belief. Moreover, moti- 
vated by the results in [T3], we impose a diffusion pay-off process into the 
principal-agent model with its drift and volatility depending on the prin- 
cipal's investment policy and the agent's effort policy. Then a stochastic 
control system is built in which the state variable is a three dimensional 
process formed by the pay-off of the agent, the Girsanov density (which is 
used for the change of measure when characterizing the value process) and 
the project's intrinsic quality, whereas the control domain is a two dimen- 
sional process consisting of the principal's investment and the agent's effort. 
We assume that the CARA constant of the agent is relatively small. As a re- 
sult, in order to maximize the agent's negative exponential expected utility 
(the cost functional of the control system) , we can approximately maximize 
the expectation of the exponent. To solve this control system, we refer to 
the weak formulation and the corresponding second-order Hamilton-Jacobi- 
Bellman equation. Since uniform parabolicity conditions do not hold for the 
state equations, there is no hope to find a classical (differentiable) solution 
for the HJB equation. Nevertheless, we verify that the value function is a 
viscosity solution of the HJB equation by verifying its joint continuity and 
establishing the Dynamic Programming Principle. Moreover, we prove that 
the value function is the unique viscosity solution with polynomial growth. 

Let us describe the content of this paper: Section 2 is mainly a review of 
the literature on Principal-Agent models and stochastic control problems. 
In Section 3, we state a principal-agent model following Giat, Hackman and 
Subramanian |13j. In Section 4, we formulate the stochastic control system 
and give some necessary conditions for later proofs. In Section 5 we first 
prove the joint continuity of the value function and establish the Dynamic 
Programming Principle. We then verify the existence and uniqueness of the 
viscosity solution of the HJB equation. 
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2 A Brief Literature Survey 



In this first part, we briefly review the literature on dynamic principal- 
agent models. In a seminal study, Spear and Srivastava [31] developed a 
significant approach that applied "dynamic contracting" models to a num- 
ber of problems in corporate finance such as CEO compensation (Wang [33J , 
Spear and Wang [32]) and financial contracting (Quadrini [29], Clementi and 
Hopenhayn [3], DeMarzo and Sannikov [U]). Holmstrom and Milgrom [IB] 
presented a continuous-time principal-agent framework in which the prin- 
cipal and the agent had CARA (exponential) preferences while the payoffs 
were normally distributed. They verified that the principal and the agent 
produced and saved via linear technologies so that the optimal contract for 
the agent is affine in the project's performance. Schattler and Sung [30J stud- 
ied incentive provision in a continuous time model and provided a rigorous 
development of the first-order approach to the analysis of continuous-time 
principal-agent problems with exponential utility using martingale methods. 
Building on the studies of Holmstrom and Milgrom [16] and Holmstrom [15] , 
Gibbons and Murphy [14] developed a dynamic framework with imperfect 
public information to study how reputation concerns affect incentive con- 
tracts for workers. Giat, Hackman and Subramanian [13] extended those 
frameworks in several ways. First, they analyzed a continuous-time frame- 
work in which both the principal and the agent took productive actions 
with continuous support. Second, they considered the general scenario in 
which there is imperfect information about the project's intrinsic quality 
and, moreover, the principal and the agent have heterogeneous belief. Un- 
der those assumptions, they derived the optimal contract explicitly which 
maximizes the agent's continuation utility ratio. They also verified that 
under the optimal contract the payoff process satisfied a certain diffusion 
equation. We follow the economic model of Giat, Hackman and Subrama- 
nian [P3] but further assume that the payoff process is a diffusion, and search 
for the optimal contract which maximizes the agent's expected utility via 
the corresponding HJB equation. For a general approach of the optimal 
contract on Dynamic Principal-Agent Problems, we refer the reader to the 
paper of Williams [35] . 

Our study is also related to the literature that analyzes the stochastic 
control problem and viscosity solutions. Many authors have introduced dif- 
ferent notions of generalized solutions in order to prove the value function 
to be the solution of the HJB equation. Kruzkov [22] - |26] built a sys- 
tematic theory for first-order Hamilton-Jacobi (HJ) equations with smooth 
and convex Hamiltonians, Fleming [10]- [11] independently introduced the 
vanishing of viscosity, combining with the differential games technique, to 
study the HJ equations. On the other hand, Clarke and Vinter [3] used 
Clarke's notion of generalized gradients to introduce generalized solutions 
of the HJB equations. In that framework, the HJB equation can have more 
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than one solution, and that value function is one of them. However, general- 
ized gradients may not be readily used to solve second-order HJB equations 
that correspond to stochastic problems. A survey of many studies of HJB 
equations is given in Bardi-Capuzzo-Dolcetta pQ. 

In the early 1980s, Crandall and Lions [8] made a breakthrough in con- 
trolled systems by introducing the notion of a viscosity solution for first- 
order Hamilton- Jacobi-Bellman equations. The first treatment of viscos- 
ity solutions of second-order dynamic programming equations was given 
by Lions [28J. Lions investigated the degenerate second-order HJB equa- 
tion using a Feynman-Kac-type technique, representing the solutions of the 
second-order PDEs by the value functions of some stochastic optimal con- 
trol problems. For general second-order equations which are not necessarily 
dynamic programming equations, this technique is clearly not appropriate. 
Jenson [20] first proved a uniqueness result for a general second-order equa- 
tion. In Jenson [20] semiconvex and concave approximations of a function 
were given by using the distance to the graph of this function. Another 
important step in the developmnt of the second-order problems is Ishii's 
Lemma [T7] . Since then the proofs and the statements of the results have 
been greatly improved. In particular, the analysis results in Crandall and 
Ishii jB] have been used in almost all comparison result. We refer to the 
survey article of Crandall, Ishii and Lions [7] for more information. Fleming 
and Soner [12j provides a rigorous approach to the control of Markov diffu- 
sion processes in M. 11 . When the uniform parabolicity condition is satisfied, 
they show that the value function is a classical solution of the correspond- 
ing second-order HJB equation. In case that the assumption of uniform 
parabolicity is abandoned, they provide a systematic analysis of the value 
function and establish a strong version of the dynamic programming prin- 
ciple by making approximations which reduce the result to the uniformly 
parabolic case. Similar results were summarized and developed in Yong and 
Zhou [36J via independent approaches. 

3 The Principal- Agent Model 

Our time horizon is [0, T] for some fixed T > 0. At date zero, a cash- 
constrained agent with a project approaches a principal for funding. The 
project can potentially generate value through capital investments from the 
principal and human effort investments from the agent. Both the principal 
and the agent have imperfect information about the project and different 
assessments of the project's intrinsic quality. The key variable in the model 
is the project's termination value process {V(t),t £ [0, T]}, which is the 
total value of the project if the principal- agent relationship is terminated 
at date t. The incremental termination value dV(t), that is, the change in 
the termination value over the infinitesimal period [t,t + dt], is the sum of 
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a base output, i.e., a Gaussian process that is unaffected by the actions of 
the principal and the agent, and a discretionary output, i.e., a deterministic 
component that depends on the physical capital investments by the principal 
and the human effort by the agent (See (|3.4f) below). 

More rigorously, consider an underlying measurable space (f2, J-) with 
probability measure P', I € {Pr,Ag}, representing the different belief of 
the principal and the agent. Let w be a standard Brownian motion and 
(Ft)t>o be the complete and augmented filtration generated by w. Let 
r\ := {r](t),t € [0,T]}, c := {c(t),t G [0,T]} be (J-t)t>o-progressively measur- 
able processes on [0,T], describing respectively the agent's choice of efforts 
and the principal's choice of investments over time. We assume that (77, c) 
takes value in U = [0, N] x [0, C], where iV represents the maximal effort the 
agent can make per-period and C represents the maximal capital investment 
the principal can afford per-period. Let := {Q(t),t 6 [0, T]} be normally 
distributed with mean 9\ and variance a\ under the measure P z , which repre- 
sents the intrinsic quality of the underlying project. Let i := {£(t),t £ [0, T]} 
be a deterministic continuous process which describes the operating costs of 
the project. Consider the value process V = gw, where g 2 is the intrinsic 
risk of the project, g > 0. Define the Girsanov Density as 

= ex p{^ {®{r) + Ac{r) a r){rf -t{r))g- l dw{r) 

- \ + Ac(r) a V (r)P - l{r)f Q~ 2 dr}, (3.1) 

B(t)=w{t)- [ {Q{r) + Ac{r) a rj{rf -l(r))g- l dr, (3.2) 
Jo 

where $(77, c) = Ac a rf is the Cobb-Douglas production function (see [5]) 
with a > 0, (3 > 0. By Girsanov's Theorem (see [21j, we temporarily 
assume the Novikov condition whose validity will be checked in Remark 4.1 
of Section 4), under the new probability measure H l such that 

£-<cn. (3.3) 

the process B is a Brownian motion. Moreover, under the same measure, 
the value process V evolves as: 

dV{t) = [Q(t) + Ac{t) a v {tf - £{t)]dt + gdB(t) 

= (6(t) - £(t))dt + gdB(t) + $(r)(t),c(t))dt . (3.4) 

base output discretionary output 

Let P := {P(t),t G [0, T]} be the pay-off process to the agent. We 
assume that the agent has a constant certainty equivalent reservation utility 
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R > 0, that is, R is the constant payoff that the agent would accept for 
the chance at a higher, but uncertain, amount. Next, a contract (P, r], c) 
is said to be feasible at date t if P(t) > R. As in the introduction, we 
assume that the agent is risk-averse with inter-temporal constant absolute 
risk aversion (CARA) preferences described by a negative exponential utility 
function. Moreover, the agent incurs a disutility of exerting effort in each 
period; that is, for any given investment policy r\ and effort policy c, if 
the project is terminated at date r (r is a (J-f)t>o-stopping time), then the 
agent's expected utility is given by 
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where the parameter A > characterizes the agent's risk aversion. The 
agent's rate of disutility from effort in the period [t, t + dt] is given by fcr/(t) 7 
with k > 0, 7 > 0. Out goal is, to find an optimal pair (77, c) which maximizes 
the agent's expected utility (|3.5I) , 

Let us now assume that the parameter A > is small enough, then max- 
imizing the utility function (|3,5p over all (^-j)f>o-progressively measurable 
processes (77, c) is approximately equivalent to minimizing the exponent 
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kri(tyZ(t)dt - P(t)£(t) . (3.5) 



This can be seen from the first order expansion. For more information about 
this type of approximation, see Whittle |34j and Yong [36]. Therefore, in 
the next section and thoughout, we will formulate the stochastic control 
problem using (|3.5p as the cost functional. 



4 The Stochastic Control Model 

Let us first reiterate our settings. Let (Q, T, (J r t)t>o, P) be a given fil- 
tered probability space satisfying the usual conditions, on which a stan- 
dard Brownian motion w := {w(t),t > 0} (with w(0) = 0) is given. Here 
(P~t)t>0 is the augmented filtration generated by the Brownian motion. Let 
Q = (R,+oo) x (0, +00) x (—H,H) be the state space where R > and 
H > 0. Let U = [0, N] x [0, C] be the control domain, where the positive 
constants > and C > represent respectively the maximal effort that 
the agent can make per-period and the maximal amount of investment that 
the principal can afford per-period. Define 

U[0, T] =< u : [0, T] x!]-tW: u is (^ r t)t>o-progressively measurable >. 
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The state equations under the control u(t) = (rj(t), c(t)), t 6 [0,T] for 
x(t) = (P(i),£(i),0(i)), t G [0,T] are then given by 

dP(t) = b(t,P(t),r](t),c(t))dt + cr(t,P(t),r](t),c(t))dw(t) (4.1) 
d£(t) = -^(t)Q- 1 (B{t) + Ari(t) a c(tf-e(t))dw(t) (4.2) 
d6(t) = 0(t)( H (@(t))dt + a(t)( H (@(t))dw(t), (4.3) 

with initial conditions 

P(0) = P > P, e(0) = 1, 8(0) = 6 e [-H, H], (4.4) 

with H > large enough. Above, 6, a : [0, T] x [R, +oo) x W -> M are 
measurable functions, while 8, a, I are continuously differentiate and deter- 
ministic functions. Moreover, Qh ■ R —* R belongs to C°°(1R) and satisfies 
£ H (9) = 1 for |9| < H - 1 and ( H (@) = for |6| > H. Finally, a and (3 
are positive constants. 

Remark 4.1 /n |^.3| ), w;e assume that Q is a Brownian motion with drift 
which is moreover absorbed at —H and H for some large H > 0. This as- 
sumption ensures the validity of the Novikov condition for £ which in turn 
guarantees the validity of the Girsanov transformation in Section 3. As- 
suming that O is absorbed at ±H is indicating that the absolute value of the 
project's intrinsic value can be large but is bounded. Moreover, using the C°° 
function (,h instead of the indicator function I|@|<# ensures the smoothness 
of the drift and the volatility, which will be used in later proofs. 

Remark 4.2 Giat, Hackman and Subramanian }13$ have shown that under 
the optimal investment policy c* of the principal and the optimal human 
effort rf of the agent, the pay-off to the agent is a diffusion process whose 
drift and volatility are functions of the optimal pair (ry*,c*). So we impose 
a diffusion process on the pay-off as in (f^.i| ) and try to solve the stochastic 
control problem (SC) described below. 

The cost function is given by 

J{u) = E{ jT k V (tyt;(t)dt - P(t)£(t)}, (4.5) 

where k > 0, 7 > and 

r = inf{t > : x(t) ^Q} AT. (4.6) 



Problem (SC). Minimize (g3|) over U[0,T], i.e. find u* € U[0,T] satisfy- 
ing 

J(u*) = inf J(u). 
ueU[o,T] 

with the corresponding state equations and initial conditions (|4.ip - (|4.4p . 
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Remark 4.3 To search for the optimal control, we need to consider a weak 
formulation. The idea of studying first a weak formulation actually comes 
from deterministic optimal problems in which one needs to consider a fam- 
ily of optimal problems with different initial times and states. But in the 
stochastic case the states along a trajectory become random variables in the 
original probability space. In order to get deterministic initial condition 
under different initial time, naturally we need to consider the conditional 
probability space. 

For any fixed s G [0, T], let A[s,T] denote the set of all five-tuples 
(f2, T, {Tt\t>s-, IP j {w(t)} s <t<T) satisfying the following two conditions: 

(i) . (Q, T , P) is a complete probability space. 

(ii) . {w(t)} s <t<T is a standard Brownian motion on (f2, J 7 , P), and {J 7 t}s<t<T 
[a{w(r),s < r < *}} s<i<T is the augmented filtration generated by the 
Brownian motion. 

For any v G A[s, T], let 

U u [s,T] =|<ii : [s, T] x f2 — > U: u is (^j)t> s -progressively measurable j. 

For any fixed (s,y) G [0,T] x Q, where Q = [R,+oo) x [0, +oo) x [-H,H], 
consider the state equations (|4.ip . (|4.21) . (|4.3|) with initial conditions 

x(s) = (P(s),{i(s), e(s)) = {P., 6, 6 S ) = y, (4.7) 
then the cost function and the value function respectively become 

J„(s,y,u) = ® {s ,y){f kri(tyffldt-P(T)Z(T)}, (4.8) 

V v (s,y) = inf J u (s,y,u), (4.9) 

u€U u [s,T] 

V(s,y) = inf V u (s,y), (4.10) 

ueA[s,T] 

T = T (s,y) = inf{t> s : x(t) &Q,x(s) = y} AT. (4.11) 
Motivated by Remark 4.3, we now introduce: 



Problem (SC). Given any (s,y) G [0, T] x Q, minimize (|4.8p over all u G 
U v [s,T), v G A[s,T], i.e., find a five-tuples ^* G A[s,T] and n* G U v *[s,T) 
such that 

J„(s,y,u*) = V(s,y), 

with the corresponding state equations and initial conditions given by (|4.1j) - 
<|Q|> and <jT7|> . 

Before moving forward, let us make some further assumptions which 
will be useful in the sequel. These assumptions correspond to a Lipschitz 
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condition in the pay-off variable. 

(CI) There exists L\ > 0, such that for <p = b,a, 

\</>(t,P,ri,c)-<t>(t,P,Ti,c)\ <L!\P-P\yte [0,T],P,Pe [R,+oo),(rj,c) G U. 

(C2) The functions b and a satisfy a polynomial growth condition in the 
variable P, i.e., there exists L2 > 0, such that 

\b(t,P,ri,c)\ 2 +\a(t,P,7i,c)\ 2 <L|(l+P 2 ),Vi G [0,T],P€ [R, +00), (rj, c) G hi. 

(C3) The functions b(-,-,r), c), a(-,-,r), c) G C 1,2 ([0,oo) x [i?, 00)) for any 
(77, c) G U, i.e., bt,bp,bpp, at, ap, app exist and are continuous. 

We now verify that the expectation in f|4.8j) is finite, making our problem 
well defined. 

Lemma 4.1 Let the conditions (CI) and (C2) be satisfied. Then for any 
(s,y) G [0,T] xQ, v G A[s, T] ; nG ^[s,T] ; 

|^(s,y,n)|<^T[^+^(l+P s 2 )e^ T +exp{(^+^C Q ^+r^- 2 T}]{4.12) 

where K > depends onL\, L2 andT, I* = max tg [ 0T ] y = (Py, Cy> 

In particular, V := {V(s,y), (s,y) G Q} is we// defined. 

Proof: Given (s,y) G [0,T] xQ,:/£ A[s,T], it G t/„[s,T], let be given 
via 

= £ y exp{ J (G(r) + Ac(r)Vr) / ' - l(r)) q~ x dw{r) 
- - / (9(r) + Ac{r) a n{rf - £{r)) 2 Q~ 2 dr} 

^ J s 

= £„£(!)(*)• 

Then the cost functional is estimated via 

< kN^ f T E {S:y) (m)dt + ^E {S:y) [ T (e {1) (t) + P 2 (t))dt. (4.13) 

With the help of the conditions (CI) and (C2), the second moment of 
P(t) can be estimated as (e.g. see Theorem 5.2.9 of Karatzas and Shreve 

M) 

E (s>y) \P(t)\ 2 < K(l + P 2 ) exp(KT), 8 < t < T, (4.14) 
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where K > is a constant depending on L\, L2 and T. Also, we note that 
£m satisfies the following stochastic differential equation 

<%)(*) = -£(i)(t)(e(t) + Ac(t) a r ? (i) /3 -e(t))g- l dw(t). 

By Ito's isometry and Gronwall's inequality, we also have, for all (s, y) G 
[0, T] x Q, s < t < T, 

= jy {s , y) [e {1) (r)(@(r) + Ac(rr V (rf - i(r)) 2 Q - 2 ]dr 

< H + AC a N^+t) 2 e - 2 [ E {Siy) e (1) (r)dr 

J s 

< exp{(# + AC a N + t) 2 g- 2 T}. (4.15) 

Combining (|4.13[) . ()4.14j) and (|4.15j) . we obtain (|4.12[) . The last statement in 
the theorem then follows since whenever z/, z> G A[s,T], for all u G J7 y [s,T], 
there exits u G £/j>[s,T] having the same distribution as u. □ 

5 The HJB Equation and Viscosity Solutions 

Let S n be the set of all n x n symmetric matrices, and <S? be the set 
of symmetric, nonnegative-definite n x n matrices. For (t, x) G [0, T] x Q, 
M G Si, z G M 3 , let 

H(t, x, z, M) = sup — f(t,x,u) ■ z — —tr(a(t,x,u)M) — L(x,u) , (5.1) 
ueu L 2 J 

where (Recalling that x = (P, £, 6) G Q and u = (77, c) G W) 

/(*,*, it) = (b(t,P,u),0,9(t)( H (e), 

a(t,x,u) = (a(t,P,u),- - 1 !i(e + Ac a r 1 P -£(t)),a(t)( H (e), 
a(t,x,u) = a(t,x,u)a T (t,x,u), 
L(x,u) = krf 1 ^. 

Then the Hamilton- J acobi- Bellman (HJB) partial differential equation as- 
sociated with the stochastic control problem (|4.8p . (|4.9p and (|4.10p can be 
written as: 

dV 

--^ + H(t,x,D x V,D 2 x V) = 0, (t,x)eO:=[0,T)xQ, (5.2) 
with the boundary condition 

V(t,x) = -P£ for (t,x) G d*0 := ([0,T] x dQ){J({T} x Q). (5.3) 
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By standard stochastic control theory, the value function (|4.10p can be ex- 
pected to be a classical solution of the HJB system ()5.2[) and (|5.3p provided 
the uniform parabolicity condition holds, i.e., provided 

3 

3h > : V(t,x,u) G O x U and ? G M 3 , V] Oy (i, x, u)q<^- > %| 2 . (5.4) 

Unfortunately, the stochastic control system does not satisfy the condi- 
tion (|5.4p ; in particular, the matrix a(t,x,u) = a(t, x,u)a T (t, x,u) is not 
even positive definite. Instead, we can search for a so-called viscosity solu- 
tion of the HJB equations, and try to connect it with our value function. 
Let C([0,T] x Q) be the set of continuous functions f(t,x) : [0,T] xQ->R 
and C 1,2 ([0, T] x Q) be the set of all / whose partial derivatives (df/dt), 
(df/dxi), (df /dxidxj) exist and are continuous on [0,T] x Q, 1 < i,j < 3. 
Next, recall: 

Definition 5.1 A function v G C([0, T] x Q) is called a viscosity subsolution 
of ISM and / TO)) , if 

v(t,x) < -P£ V(t,x) G a*0, (5.5) 

an<i for any ip G C 1,2 ([0,T] x Q), whenever v — tp attains a local maximum 
at some (i, x) G O, we have 

- ip t (i,x) +H(i,x,-(pt(i,x),-ip xx (t,x)) < 0. (5.6) 

A function v G C([0,T] X Q) is called a viscosity supersolution of J23J) 
and A5.3\) if in \5. 5|) and 15. 6\) the inequalities "<" are changed to ">" and 
"local maximum" is changed to "local minimum". When v G C([0, T] x Q) is 
both a viscosity subsolution and a viscosity supersolution of H5.2\) and \5. 3\) . 
then it is called a viscosity solution of A5.2\) and L5.3\ ). 

In studying viscosity solutions of a second-order, nonlinear parabolic 
HJB equation, an equivalent definition in terms of second-order subdiffer- 
entials and superdifferentials is also useful. 

Definition 5.2 Let v G C([0,T] x Q). 

(i) The set of second (parabolic) superdifferentials of v at (t,x) G [0, T) x Q 
is 

D {1 ' 2) ' + v{t, x) = | (q, p,i)£lxK 3 X(S 3 : 

v(t+h,x+y)-v{t,x)<qh+p ■ y+^Ay ■ y+o(\h\ + \\y\\ 2 ) 
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(ii) The set of second (parabolic) subdifferentials of v at (t,x) G [0, T) x Q 
is 

D^' 2) '-v{t,x) = -D (1 ' 2) ' + {-v){t,x) = Uq,p,A) G R x M. 3 x S 3 : 

v(t + h,x + y)-v(t,x)>qh+p ■ y+^Ay ■ y + o(\h\ + \\y\\ 2 ] 

Definition 5.3 For v G C([0,T] x Q), G [0,T) x Q, the closure of the 

set of sub and superdifferentials are 

D {1,2),± v(t,x) = { (q,p,A) G K x M 3 x S 3 : 3(t n ,x n ) G [0,T) x Q -» (t,x), 



(q n ,p n ,A n ) G D (1 ' 2),± ?;(i n , x n ) -» (g,JJ,A)) 

From Definition 5.2, it follows that if <^ G C 1,2 ([0,r) x Q), then 

DW>+(v - <p){t, x)={{q- (pt(t, x),p- D x <p(t, x), A - D 2 Mt, x) : 

{q,p,A)eD^ + v(t,x))}. 

As a consequence, the same statement holds if L)( 1,2 )'+ is replaced every- 
where by , D {1 ' 2) ' + or D {1 ' 2) '~ . 

It is not hard to see that the above characterization of the second-order 
sub and superdifferentials yields 

-q + H(t,x,p,A)<0, V(q,p,A) eD {1,2) ' + v(t,x), (5.7) 

-q + H(t,x,p,A) > 0, V(q,p,A) £D {1 ' 2), ~v(t,x). (5.8) 

The above inequalities form an equivalent requirement to viscosity solu- 
tions. We start with stating two results towards obtaining this equivalence. 
The proof is given in Fleming and Soner [T2] (Lemma 5.4.1). 

Lemma 5.1 Let (t, x) G [0, T)xQ be given. Then (q,p, A) G D^' + v(t, x) 
if and only if there exists v G C 1,2 ([0, T] x Q) satisfying 

d \ 

—v(t,x),D x v(t,x),D 2 x v(t,x)j ={q,p,A), (5.9) 

such that v — v achieves its maximum at (t,x) G [0, T) x Q. Similarly, 
(q,p,A) G D^' 2 ^~v (t, x) of and only if there exists v G C([0, T] x Q) satis- 
fying &5.y\) such that v — v achieves its minimum at (t,x) G [0, T) x Q. 

An immediate corollary of the above result is this. 

Proposition 5.1 v G C([0, T] x Q) is a viscosity subsolution of \5.2\i and 
K5. 3\) if and only if |5. 7| ) holds for all (t, x) G [0, T) x Q and H5.5\) holds for 
all (t,x) G d*0. Similarly, v G C([0, T] X Q) is a viscosity supersolution of 
(EU and fOj) if and only if fOj) ZioWs for all (t, x) G [0, T) x Q and 
ZioWs /or a// (i 5 x) G [0, T) x Q icii/i "<" changed to ">". 
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5.1 Continuity of the Value Function 

As seen in Definition 5.1, in order to prove that the value function (|4.10p 
is a viscosity solution of (|5.2p and (|5.3p . the first step is to prove the joint 
continuity of V, in the variables (t,x) G [0, T] x Q. The main difficulty in 
trying to do so is the fact that, for different starting time, the underlying 
probability spaces vary (indeed the starting points of the Brownian motions 
are different). So one cannot prove this joint continuity directly by estimat- 
ing the difference of two expectations. In order to get the joint continuity, 
we first give some more conditions on the drift b and on the volatility a of 
the pay-off process. 

(C4) The functions b and a satisfy a linear growth in the t variable, i.e., 
there exists L5 > 0, such that 

\b(t,P,r],c)\ + \a{t,P,r],c)\ < L 5 t 

for all t G [0, T], P G [0, +00), (77, c) G U. 

To begin with, here is an elementary tail estimate. 

Lemma 5.2 Let X = {Xt : t G [0, T]\ be a semimartingale, i.e., X% = 
x + Alt + Ct with x G R, M a continuous local martingale, C a continuous 
process of bounded variation. Assume that there exists a constant k > 
such that \Ct\ + (M)t < nt, for all t > is valid almost surely. Then for 
any fixed T > and sufficiently large n > 1, we have 



\ max \X t > n\ < — \ — exp \ —}. (5.10) 



Proof: Taking n > 3max{|x|, kT} and letting R n := inf{£ > : \Bt\ > 
n/3}, where B is a suitable Brownian representation of the continuous local 
martingale M (e.g. Theorem 4.6 of Karatzas and Shreve [21j). we have 

|max|X 4 |>n) C ( max \M t \ > -\ = ( max \B (M) .1 > -) = \{M) T > R n ) 

C {KT>R n }, 
which lead to (T s = inf{t > : (M) t > s}) 

P{ max^ \X t \ > n) < P{R n < kT} < 2P{T n/3 < kT) = 4p{b kT > |} 
The proof is complete. □ 



It is now time to state and prove the main theorem of this section which 
shows the joint continuity of the value function (|4.10p . The idea of the proof 
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is similar to Fleming and Soner [12] Lemma 4.7.1 and Theorem 4.7.2. We 
first restrict the state space to some compact area with smooth boundary 
and add some small perturbation on the volatility of the state equation to 
make it satisfy the uniform parabolicity condition. Then we show that the 
value function corresponding to the new state equation, with compact state 
space, is continuous. Moreover, we verify that this value function does not 
depend on the choice of the reference probability space, i.e., V p = V p n fl in 
the notations of (|5.15|) and (|5.16|) below. Finally, we show some uniform 
convergence as the perturbation goes to zero and the bounded state space 
goes to the unbounded state space. This implies that the same statement 
holds for the value functions as in (|4.9|) and (|4,10p . 



Theorem 5.1 Assume that the conditions (Cl)-(C^) hold. Then the value 
function V as given in IQty is continuous on [0, T] xQ. Moreover, V(s, y) = 
Vp{s,y), for all p G A[s,T]. 

Proof: Step 1. Fix any p > R, and consider first the following region: 



Qp = {>> 



(P,e.6)€Q: Pg (R,p),te (~,p),Qe 



-H,H)}. 



We then smooth dQ p so that dQ p G C 3 . Consider the function a p : Q —> 
[0,1] such that a p G C°°(Q), a p (x) = 1 for x G Q p and a p (x) = for 
Q\Q P+1 . Next, let 



f p (t,x,u) 
a p (t,x,u) 
L p (x,u) 



f(t,x,u) ■ a p (x), 
a(t, x, u) ■ a p (x), 
krp£ • a p (x). 



Now fix s G [0, T], y G Q p and < e < 1, given any reference probability 
space fj, = (O, J 7 , {^t}t> s , P, w, w\) where w\ is another Brownian motion 
independent of w with staring points w(s) = wi(s) = 0, a.e., for each n G N, 
consider the following stochastic control system 



dx p n) {t) = f p (t,x p n \t),u(t))dt + a p (t,x p n \t),u(t))dw(t) 



x p n \s) 



+ e n I 3 d Wl (t), 

y e Q P , 



(5.11) 
(5.12) 



r («) 
p 



jQ(s,y,u) = E {s>y) / L p {xf\t),u(t))dt - P p (n) (^ n) )eJ n) (r(«)) (5.13) 



f = Tj?\s,y) = inf{t > s : xf\t) Q p ,xf\s) = y} A T, (5.14) 
/ (3) = (1,1, 1) T , 
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v&H*,v)= , inf M{s,y,u), 

Vf)( S ,y)= MV^(s,y). 



li£A[s,T) 



(5.15) 
(5.16) 



Remark 5.1 Note that V p (s,y) in H5.16\) is defined on a six-tuplet p, in- 
stead of a five-tuples v. However, given p = ($7, J 7 , {J^}t> s , P, w, w±), set- 
ting v = (f2, T , {.Ft}t> s , P, w), any u £ Up[s,T] is also in U u [s,T]. On 
the other hand, given v, consider another reference probability system v' = 
(Q'jJ 7 ', {^-"/}t> s , P', w') with {w'(t)}t> s & standard Brownian motion adapted 
to {J-l}t> s - For {uj,u ! ) £ (f2,f2') ; t > s, consider the Brownian motions 
w(t,uJ,Lo') = w(t,uj) and wi(t,uj,uj') = w'(t,uj'). Thus, setting 

p= (QxQ'^X J 7 ', {F t x ^}t> S) P x P', w, Wi) 

and if u £ U u [s,T], we can regard u as an element o/ f^fs, T] which does 
not depend on tu' . 

Now for fixed n £ N, the HJB equation corresponding to the stochastic 
control system ()5.1ip - (j5.16p is given by: 




+ H p n \t,x,D x V} n \D 2 x V p ^) = (t,x)£[0,T)xQ p , (5.17) 



with the boundary condition (setting O p := [0,T) x Q p ), 

V} n \t,x) = -P£ (t,x)£d*O p , (5.18) 

where 

H p n) (t,x,z,M) = Bwp[-f p (t,x,u) ■ z-\tr{a p n) {t,x,u)M) - L p (x,u)], 

oW = {op,e n h){a p ,e n h) T . 

Note that the equations (|5.11|) - (|5.12p satisfy the uniform parabolicity condi- 
tion ()5.4p . By classical stochastic control theory (e.g., Theorem 4.1 of Flem- 
ing and Soner [T2]) and noting that the drift and volatility vectors satisfy 
conditions (C2) and (C3), (|5.17p - (|5.18p has a unique solution W( n \t,x) £ 
C 1 ' 2 (Op)f]C(O p ). For any 5 > small enough such that p - 5 > R, the 

partial derivatives W t , Wx , Wxx^ are uniformly continuous on O p s = 
[0,T — 5] x Qp-5, where Q p s is defined in the same way as Q p with p re- 
placed by p — 5. Hence for any e > 0, there exists A > 0, such that whenever 
(t, x), (t', x') £ Ops with \t - t'\ < A, \\x - x'\\ < A, then 

\A u W^(t,x) + Lp(t,x,u)-A a W^\t',x')-Lp{t',x',u)\ <-£=, (5.19) 
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for all u G U. Here A U W^> is given by 

jj'=l i=l 

with 4 n) (t, x, u) = a p n) ■ (a p n) ) T , a p n) = (a p , e n I^) T , and the HJB equation 
(|5.17p can be written as 

mm[A u W {n) + L p ] = 0. (5.20) 

Now we choose M large enough so that M~ l {T — s) < min(A,l), and 
partition [s,T — 5) into M subintervals Ij = i = 1, . . . , M. Also, 

we choose Kq > large enough and partition Q p s = B\ U Bi U . . . U Bk , 
where the Bj, j = 1, ... ,i^o are disjoint Borel sets of diameter less than 
A/2. Pick £Cj G Bj. For each i = 1, . . . , M, j = 1, . . . , if , by ([530]) . there 
exits Ujj G such that 

^wWfe^O + Lpfo,^,^) < ^. (5.21) 

Combining (|5.19p and (|5.21[) . for t G ij, |x — Xj| < A, we have 

^(t,i) + L )l (( ) i ) iii i ) < ^. (5.22) 

Pick an arbitrary uq £ U and define the discrete Markov control pol- 
icy u = . . . , u M ), corresponding to the partition Ii = [ij,tj + i), i = 
1,...,M, by 



x G Bj,^ = 1, ... , i^o, 
n (t,x) G 0\ Op- S . 



Define, by induction on i, u G C/^fs, T] and solution Xp"^(t) to (|5.1ip and 
(|5. 12|> with control u such that 

u(t) =Mi(x(ti)), tel h i = l,...,M, 

(This is done by induction on i since for t G ij, x(t) is the solution to (|5.1ip 
with -measurable initial data x(ti), and for t G [T — 5, T], x(t) is the 
solution to (|5.1ip with Tt M -measurable initial data x(tM+i))- Thus 



u(t) = u^, t G Ii, x(ti) G Bj. 



By Dynkin's formula, for any {.Ft}i> s -stoppmg time 9, (s, y) G O p s, t p 
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inf{t > a : xf\t) Q p s} A (T — S), 6 { p n > 5) = t^ 5) A , 



„(n,<5) 



E, 



W)( / " ^(^(^"(^A + ifW^,^^)) 

„(n,5) 

E (.,i/)(/ P [^^ (o) (M? ) W)+i/.(f(*)>«W)]A5.23) 



(since W^ n > 6 C 1,2 (Op_5)). We need to estimate the second term in (|5.23p . 
To that effect, define 

r = {u: xf\t) e Q^s, \\xW(t) - xW(ti)\\ <^,tei i} i<i<M}, 
then for t € [s, T - 6), by (|5T22l . 

i^W(t,4")(t))+L p (f (t),u(t)) < ^ on r, (5.24) 

By the very definition of f p , a p , the drift and volatility vector are both 
bounded. Hence for all i = 1, ... , M, 



% >tf) (™||xJ n) (t)-4 n) (*i)lloo>^) < X^D 2 (t l+1 -t t f 



\\xp{t)-X^{ti)\\oo > A 

from which it follows that 

P^fmaxUxW^-xW^Hoc^^) < M- 1 \- 4 D 2 T 2 , (5.25) 

where, above, we used the following result (e.g. (D.12) on P.406 in Fleming 
and Soner [12]): for each k £ N, 5' > 0, 

P{ max - x(ti)|| > <5'} < 5'- 2k D k (t 2 - h) k , (5.26) 

te[ti,t 2 ] 

where D k > is a universal constant depending only on p, T L\ and L 2 (as 
in (CI) and (C2)). Since 

IP (s , y) (r c ) < ¥ {B Jm^\xf\t)-xf\u)\ > X 



Xi^V p K ' p v Vl -2/' 

we obtain that 

E (sJ I [A u w^+L p )dt)< £ -+ max p-iy( n )+L p ||p (Si3/) (r c ) 

Vis / 2 (t,x)€[s,T-S]xQ p _ s 

< £ + M « W (n) +L p || (M)e[SjT _, ]x ^M- 1 A-^T 2 . 



17 



Therefore, for fixed p, 6 > 0, for any (s,y) G [0, T — 5] x Q p s, if we pick 
M > large enough, then for any reference probability system [i G A[s, T], 
there exists u G C/^[s,T], such that for any stopping time 9, 



W(%,y)+e>E {S)y) ( j " LX4 n) ( t )^(*)) dt + w(n H n ' 5) '4 n) (<' <5) ))( 5 - 27 ) 

Also, by (fCTL for any s G [0,T], fi G A[s,T], u G U p [s,T], < ^"VF^ + 
L p , so (|5.23|) implies 



v 



W (n) (s,!/)<E( S) J / .(5.28) 



We need to take 5 in both (|5~27j) and (pT28|) . Note that PK (n) is con- 
tinuous and thus uniformly continuous on O p , and so there exists < 
K\ < min{l,2e}, such that, whenever | £ — s | < ki/2, \\x — x'\\ < k\/2, 

(t,x), {t',x')eo~ p , 

\W {n \t,x) - W {n \t',x')\ < e. (5.29) 
From (fQ6|) and ([522]), we obtain that, 

E {Sty) \w {n \9 p n ' 5 \x p n) (9^)) - w {n \e a 4 n \x p n \e a r^ n) ))| 

< 2\W {n \bf{s,y){^ ] -r { p n ' S) > ^or\\x p n \9^)-x p n \9 A r^)\\ > ^}+e 

< nW^\\ {Sty)e o- p (e + D 1 e)+e. (5.30) 

Moreover, given any [i G A[s,T], u G U p [s,T], note that clearly there 
exists Jo > 0, such that for any < 6 < 5q, 



<>y)\'p ' p 8 ) 



(since the events {t p — T p n,S ^ > nf /8} are monotonically decreasing to the 
empty set, as 5 — » 0). So 



r- /"I/ / V 

E 



(n,S) 
P 



L p (x p n \t),u(t))dt] < ||L p || £+ || J L p ||rP (S) , ) {rW-rM)>^} 
< ||L p ||(T + l) e . (5.31) 



Combining ()5.30p and ()5.3ip . we obtain that for any s G [0, T), y G Q p , 
fi G A[s,T], u G U p [s,T], any stopping time 9, 

lim sup (E (S)tf) |W( n) (^*),xW(^)) - ^ fl '(9 A Tp\x£\0 A r^))| 



+ E 



(«>!/) 



(n,S) 
P 



L p (x p n \t),u(t))dt ) =0. (5.32) 
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Hence in (|5.28p . taking 5 — ► 0, we obtain that for any s G [0, T), y G Q p , 
fi G A[s,T], u G U p [s,T], any stopping time 9, 



Jn) 



W^\s, y) <E (a)tf) ( jf ' A r(")f(9 A r^)))5.33) 

Moreover, by (|5.32p . for any A > 0, any reference probability system /i G 
A[s,T], u G C/[s,T], there exists <5i > 0, such that whenever 5 < 5\, for any 
stopping time 9, 

^( s ,y)\W (n \9p So \x^\e^)) - W (n \9 Arj"',xW(e Ar^))| 



+ E 



(n,5 ) 



L,(4 n >(t),u(t))di <-. (5.34) 



Also, for any (s,y) G [0, T) x Q p , pick 52 > small enough so that (s,y) G 
O p _<5 2 , then by (|5.27p . for 5q = min{(5i,52}, for any reference probability 
system /j, G A[s,T], there exists u G U p [s,T], such that for any stopping 
time 9, 



^)( Sl!/ )+->E M ( / ' L p (xW(t),n(t))dtW (n) (^ nA) ,4 n) K n ' 5o) ))- 

(5.35) 

Hence, combining (|5.34p and (|5.35p . we obtain that 

W^\s,y) + A>E {s ^j L^HtMt))dt+W^\9AT^\x^\9AT^)y 

(5.36) 

Note that (|5.33|) and (|5.36p are trivially true on d*O p , so we can extend 
those two inequalities to all (s, y) G [0, T] x Q p . In particular, by picking 
the stopping time 9 = T, then for any reference probability system fj,, we 
have by (l533l and (IQBj) . 

_(») 

WW(*,y) = inf E(., y }(/' L p (x(")(t),u(t))dt-P(")(rW)^(rW)), 
= ^)( S ,y), (5.37) 
which implies that for (s, y) G [0, T] x Q p , 

wW(s,y) = inf V$(a,y) = V p ^(s,y). 

Therefore, for any p > 0, s G [0,T], y G Q p , /i G A[s,T], 

yW( S ,y) = yW( S , y )GC(O p ). (5.38) 
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which achieves the proof of Step 1. 



Step 2 For the region O p considered in Step 1, let the stochastic control 
system be described via: 



dx p (t) 
x p {s) 



f p (t, x p (t), u{t))dt + aJt, xp(t),u(t))dw(t), (5.39) 



V G Qp, 



E 



(5.40) 

Lp(x p (t),u(t))dt - Pp(Tp)tp(T p )} , (5.41) 



t p = t p (s, y) = inf {t > s : x p {t) Q p , x p {s) = y} AT, (5.42) 

V p ,p(s,y)= inf J pfl (s,y,u), (5.43) 
V p ( S ,y)= inf Vp^y). (5.44) 

p,&A[s,T\ 

By Remark 5.1, we can build a one-to-one correspondence between all 
five-tuplet u = J 7 , {.Ft}t> s ,P, iu) and six-tuplet /x = (f2, J 7 , {^-"t}t> s , P, wi), 
and so we can regard those two expectations in J P:l/ (s, y, u) and Jp™ p (s, y, u) 
as defined on the same probability space. Then for (s,y) 6 [0,T] x Q p , 

|Jp,„-42l ^ [" Lp{x p {t),u{t))dt- T Lp(x p n \t),u(t))dt 

J S J S 

+ E is>y) \Pp(Tp)Zp(T p ) - P^(rW)^)(rW)| 

/•T 

< (feiVT + max|| a; || 00 )E {S)2/) / ||ar p (t) - x p n > (t^dt 

xeQp Js 

< {kW + v a .^\\x\\ oo )B T\\a p -a n p \\ oo 

x<=Q p 

= (kN 1 + max\\x\\ oo )B Tw n , 

xgQ p 

(n) 

where we note that the drift function for x p and for x p are the same and 
the estimation 

E\M) ~ 4 n) (-)IU < B \\a p - a^\U (5.45) 

for some constant Bq depending only on p, T, L\ and L2 (e.g. (D.9) on 
P.405 Fleming and Soner pj). 

Therefore as n — > 00, Jp\ p (s, y, u) converges to J PtP (s, y, u) uniformly for 
all (s,y) £ O p , p £ A[s,T], u £ Up[s,T]. It follows that uniformly in all 
(s,y) G Op, 

V^{s,y)^Vp{s,y), n - 00, (5.46) 
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which implies that V p (s,y) G C(O p ). Moreover, since for any (s,y) G O p , 
p G A[s,T], V p ^(s,y) converges to V P:P (s,y), as in oo, and in a pointwise 
manner, V p n p {s,y) = V p n \s,y), we have 

V p ( S ,y) = V p , p (s,y), (5.47) 

for all n G A[s,T], (s,y) G [0,T] x O^. This finishes Step 2. 



Step 3. We finally consider the stochastic control system (|4.ip - (|4.3p . 
(|4.7p - (|4.1ip . For any compact subset C C Q \ {£ = 0}, we can find p > 0, 
such that C C Q p . Note that when s < T p , the trajectories of x p (t) and x(t) 
are exactly the same. Also, if at time t p , x(t) passes through the surface 
{x = (P, £, 0) G Q : P = R}, then t p = t. We first show that for p large 
enough, with large probability x(t) will first penetrate {x = (P, £, G) G Q : 
P = R} before it passes through the other surfaces of Q p . In fact, since is 
bounded, and since the condition (C4) guarantees that P satisfies Lemma 
5.2, for any e > 0, there exists po > independent of the starting points, the 
reference system and the control, with C C Q po , such that for any p > po, 

P i8tV) {mBxP(t,u) >/>}<!» (5-48) 

for any u G U„[s,T], p G A[s,T], (a,y) G [0,T] x C. 

Note that £ is a positive martingale. So by the (sub)martingale maximum 
inequality, for p > 4max xg c l£l e_1 ; we obtain that for any u G U p [s,T], p G 
A[s,T], (s,y) G [0,T] xC, 

> Pi < P _1 E( Sj2/ )(e(r)) < p- 1 max |£| < J. (5.49) 

Also, let q(t) := t G [s,T]}, note that 

:= ?(t) exp { - J (0(r) + Ac(r) a 77(r) / ' - ^(r)) 2 ^ 2 dr}, 

is also a positive martingale (since it is also a Girsanov density). So if we 
pick p > 4Tmax.ec exp {(H + AC a N? + tf q~ 2 T) e' 1 := L{T,C)e~ l , 
it follows from Markov's inequality that 

P (a , y) { nun^t) < p- 1 } (= P M {ma f (t) > p}) 



< P 1]E (s,y)( s max ?(t)) 

< p" 1 exp {(H + AC a A^ + £*) 2 g- 2 T}E {s ^ y) ( max 0(t)) 



s<t<T 
T 



< p^T max ir 1 ! exp {{H + AC Q 7V^ + t) 2 g~ 2 T} < J, (5.50) 
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for any u G U^[s,T], \i G A[s,T], (s,y) G [0,T] xC. Combining (IQHD - dCT]) . 
we have for p > max{po> 4max Ig c i 







, v ){t p < r} < e, 



(5.51) 



for all aeW^Tj./ie A[s,T], (s,y) G [0,T] x C. 

Now using conditions (CI) and (C2), from (D.7) of [T5] P.405, we obtain 

E {Siy) \P{t)\ m < B m {\ + \P s \ m ),m > 1, (5.52) 

where B m is a constant depends on p, L\, L2 and T. Also, note that 

e 4 (t) = £ s 4 exp {4 J (9(r) + ,4c(r) a r ? (r) /3 - £(r))e _1 dtw(r) 

- 2 y (0(r) + Ac^^r)^ - £(r)) V 2 cir} 

= exp {6 y (0(r) + Ac(r) a 7?(r)^ - £(r)) V 2 cir}, 

where 



^(t):=exp|4 y (9(r) + Ac(r) Q ?7(r)^ -^(r))^ 1 ^^) 

- i y 16(9(r) + vlc(r) Q 7 ? (r) /3 - l{r)f g- 2 dr} , 

is a Girsanov density satisfying the Novikov condition and is thus a martin- 
gale. Hence, we can estimate the moment of £ 4 (i) as: 

E (S)2/) £ 4 (i) < expjeT^ + ylC^ + r) 2 ^ 2 }^,)^^) 

= exp{6T(tf + yLC a A^ + r)V 2 }£ 4 , (5.53) 

for any (s,y) G [0,T] xC./ie A[s,T], u G t/ M [s,T]. Therefore, by (j4TT5) . 
([53ZD and (I53H1) . 



E 



s,.y 



< E 



s.i; 



< fcA^E 



i"(s,2/) 



fe^CtreCtJrft-PCrCa.yJ^CrCs,!/))}' 



(p 4 (t)+c 4 w)^ 



< kN^Tmax |£| 2 exp{(i? + AC a A^ + r ) V 2 T} + ~£ 4 (1 + max |P| 4 ) 
+ -Tmax (CI 4 exp {6T(H + AC a N p + tf q~ 2 } 

(5.54) 



2 x-ec 
K(T,C) < 00. 
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Further, by (|5.5ip and (|5.54p . for any e > 0, (s,y) G [0,T] x C, u G 
t/^fsjT], /i G A[s,T], when p > maxjpo, 6max xg c -^(^C)e^ 1 }, we 

have by the Cauchy-Schwarz Inequality that 

k V (tyt(t)dt - P(r(s, yM(r(s, y))] } 

2 1/2 

^(t)^(t)dt-P(r)e(r)} ) (P {SiS/ ){r p < r}) 



1/2 



< K(T,C) L '*e L ' 2 , (5.55) 

which implies that uniformly in all (s,y) G [0, T] x C, Vp(s,y) — ► V(s,y), 
as p — > 00, and hence V(s,y) G C([0,T] x C). Moreover for all G A[s,T], 
we have V(s,y) = V^(s,y). Since C is an arbitrary compact set, we obtain 
that V{sJ) G C([0,T] x {Q\(x G Q : £ = 0)}), and ^(s,y) = t£(s,j/) on 
[0,T]x{Q\(x G Q : £ = 0)} (and thus on [0, T] x Q since on {x G Q : £ = 0} 
these two value functions are both zero). The continuity on the boundary 
[0, T) x {x G Q : £ = 0} follows from (|4TT2l) of Lemma (4.1) since V(s, y) = 
on [0, T] x {x G Q : £ = 0}. Therefore, we finally have 

V(s,y)eC([0,T]xQ), V(s,y) = V^s,y), V/i € A[a, T], Vs G [0, T] (5.56) 

The proof is complete. □ 

5.2 The Dynamic Programming Principle 

In order to prove that the value function is a viscosity solution of the 
corresponding HJB equation, and besides multivariate continuity, we also 
need to show that the Dynamic Programming Principle is satisfied. In fact, 
a result which is a stronger version of the traditional dynamic programming 
principle is verified in this section. 

Definition 5.4 The value function V is said to satisfy the Dynamic Pro- 
gramming Principle if, for any (s,y) G [0, T\ x Q and (J-'t) 't>s~ stopping time 



V{s,y)= inf ®( s ,y){[ L(x(t),u(t))dt + V(t A 9, x(t A 0))}(5.57) 

jueA[s,T] 

Definition 5.5 The value function V is said to satisfy the property (DP) 
if, for any (s, y) G [0, T] x Q, the following two conditions hold: 
(i) For any \x G A[s,T], u G U^[s,T] and (.Ft) t>s~ stopping time 9, 

V(s, y) < E (S)?/ ) I f L(x(t), u(t))dt + V(9 A r, x{9 At))}. (5.58) 
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(ii) For every 5 > 0, there exists /i G A[s,T] and u G U p [s,T] such that for 
every (J- t)t>s- stopping time 6 



V(s,y) + 5>E {Sty) {j L(x(t),u(t))dt + V(0 Ar,x(6 At))}. (5.59) 

Clearly the property (DP) immediately implies the validity of the Dy- 
namic Programming Principle. In the next theorem we establish the validity 
of the property (DP) for our value function (|4.1U|) . using an approach similar 
to that of Theorem 5.1. But we first need the following lemma. 

Lemma 5.3 Given (s,y) G [0, T] x Q p , ^ G A[s,T], u G U p [s,T], then as 
n — > oo, 

7-W -» t p a.e.-F (Sty) , 

where T p n ^ and r p are respectively defined in |5. 14\ ) and {5.^2^ . 
Proof: By (|5.45|) . for any e > 0, 

lWH4 n) Q-Zp(-)ll>£} ^ e-'E^Wx^i-) - x p (.)\\ 

< e- 1 B \\ff p -^\\<e- 1 B w n , 

which immediately implies that 

oo 



Hence by the Borel-Cantelli Lemma, there exists HoQ^ with P( S)2/ ) iSk) = 1, 
such that 

x p n ^(r) — > x p (t) uniformly in t 6 [s,T], n — > oo, G fig. 

Therefore, for any G do, T p a \uj) — > Tp(u;) as n — ► oo, which completes the 
proof of lemma. □ 

Theorem 5.2 Assume that the conditions (C1)-(C3) are satisfied. Then 
the property (DP) holds for the value function V . 

Proof: Step 1. The property (DP) of V p [n) has been established in the 
proof of the previous theorem as (|5.33j) and (|5.36p . 
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Step 2. Consider now the value function V„ as in (|5.44p . For any 
(s,y) G [0,T] x Q p , \x £ A[s,T], u £ ?7 M [s,T] and (J^) t > s -stopping time 9, 



E 



(»,t/) 



< E 



< E 



V p (9 A r p , x p {9 A r p )) - V™ (9 A Tp\x<?\0 A rW)) 

^p(# A r p , * p (fl A r p )) - A ^ p n \x p n \9 A r^)) 

y p (0 A r p , x p (9 A r p )) - yW {9 A Tp\x£X0 A rW)) 
l/ p (0 A r p , * p (# A r p )) - y p {9 A f , x W (9 A rj"')) 

(<? A r W , f ((9 A r W )) - 1*° (9 At p , x p (9 A r p )) 



J (4 n) >r P ) 



J (r< n) <r P ) 



(^ n) >r p ) 



+ 2||V p -FM|| 
= h + I 2 + h. 

By (|5.46[) . for any e > 0, there exists N\ £ N, such that whenever n > N±, 

h = 2\\V p -V p W\\<e. (5.60) 
Next, we estimate I\ as follows: 

h < E { ^I (e<4n)<Tp) [V p (9,x p (9))-V p (9,x p n \9))] 



+ E 



( s ,y) 



+ E 



(s,y) 



Jl + J 2 + J 3 . 



(5.61) 



Since V p is uniformly continuous in [0, T] x Q p , for any e > 0, there exists 
< 5q < min{l,2e}, such that whenever (t,x), (t',x') £ [0, T] x Q p satisfy 
I* ~~ + ll x ~~ < ^0) w e have 



\V p (t,x)-V p (t',x')\<e. 



(5.62) 



Also, using (|5.45p and Lemma 5.3, there exists N 2 £ N, such that whenever 

n > N 2 , 



B (s,y) ) \\ x p(') x p 



rjW|>f> . 



(5.63) 
(5.64) 
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which implies that 



Jl < E (s,i/) 

+ E r . 



< (2 max_|V p (i,x)| + l)e. 

(t,cc)eO p 



(5.65) 



For J 2 and J 3 , set Ai := { \\x p (r p ) - Xp n \r { p n) )\\ > 5 /2}, A 2 := {\4 n) -t p \ > 

6%/8} and A 3 := {\\x p {-) -a^OlU > <V 4 }, then by (fOSj) . ([TO)) and 
(|5.26p . we have 

¥ {s>y) (Ax) < ¥ {s>y) (A 2 ) + P (a>tf) (Ai n A|) 

P ( , >tf) (A 2 ) + P (j , itf) (40 +P( S)2/ )(A| n {||x p (r p ) -x p (rW)|| > |}) 



< 



< 2e + Diy < (2 + Di)e. 
Hence by (IfTBH . (IfTMD and B . for n > JV 2j 



(5.66) 



E 



({^ n) <r P <0}n (Ax u A 2 )) I ^ ( t p ' x ^ ^ ^ v p( T p n) i x P n) ( T p n) ))\ 



+ E 

< (4 ma^|y p (t,x)|e + e) = (4 max_ \V p {t, x)\ + l)e, (5.67) 

(t,x)eo p ' (i,x)eo p 



J 2 < E 



+ E 



i s >y) 



p\' p i""p \' p 
^ P ( T p n \ x p n \ 1 p 



(5.68) 



< (4 max^\V p (t,x)\ + l)e. 

Combining (I53TT) . (15351) . (15371) and (15^81) . for n > iV 1; 

Jl < (10 max_|y p (t,x)| +3)e. 
(t,x)eO p 

Similarly, we fix N = max{iVi, N 2 } in I 2 and then by (|5.60p . 

I 2 <(10 max_|y (Ar) (t,j;)| + 3)e < (10 max_ \V p (t, x)\ + 8)e. 
(t,x)eo p (t,x)eo p 

Hence, whenever n > N, for any {^j^s-stopping time 6 (rjfg := A t p , 
Tpfi ■= A r p ), 

E(.*)|^(w,x p ( W )) -^(^S'^^S))! ^ (20||^||o-+12)e, 
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which directly implies that, 



Jim swpE (s JV p (T p ,e,x p (r p> e)) - V™ (t$ , f (rg ) ) | = 0. (5.69) 
Moreover, by (|5.64j) . 



E 



.(«) 

p,6 



L p {x p {t),u{t))dt- / ' L p (x( n) (t),«(t))^ 



< IlLjTP^jlrp-TW^Il + II^II^Cr + l)!^^. (5.70) 
Therefore, combining (|5.69|) and (j5.70p . we obtain (uniformly in all (s,y) G 

O p , fxe A[s,T], ue U„[s,T]) : 



lim sup Ef s v \ 



L p (x p (t),u(t))dt + Vp{Tpfi,Xp{T pfi )) 



» 



- T/ (n) (rS,xW(r^)) 



p \'p,0>~p \'p,t 



0. (5.71) 



Together with (|5.33p in Step 1 of the proof of Theorem 5.1, for any (s,y) G 
O p , /x G A[s,T], u G [/^[SjT], for any (^) t > s -stopping time 6*, 



F p (s,y) <E (S)J ,){ J Lp(xp(t),u(t))dt + Vp(Tp t 0,Xp(rp >e ))j, (5.72) 

which is the inequality (|5.58p for the value function V p . 

To get the inequality (|5.59p . for any 5 > 0, pick n > 1 large enough in 
(15771]) . so that 



supE (Siy) 



L p (xp(t),u(t))dt + P^(t^, x p {Tpfi)) 



r (») 



L p (xW(t),u(t))(ft - ^(rWzW^)) 



p \'p,V>-"P \'p,t 



< 



For this n, for any (s,y) G O p , it follows from (|5.36p that we can pick a 
six-tuple n G A[s,T] and u G J7 M [s,T], such that 



^p (n) ( S ,y) + 2 / " L p (xW(<),ii(t))cft+yW(r^\ a :W(TW))}(5.73) 

Note that by Remark 5.1, it G £/j,[s,T], where z/ is obtained by omitting the 
last component W± of the six-tuple \i. Therefore we have 

V p (s,y) + 5 >K (Siy) { j^' 6 Lp(x p (t),u(t))dt + Vp(Tp )8 ,Xp(Tp fi ))}, (5.74) 
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for the choice of u as in (|5.73|) . Therefore, the property (DP) holds for the 
value function V p . 

Step 3. We finally establish the validity of the property (DP) for V. 
Without loss of generality, for any (s,y) G [0, T] x Q \ {£ = 0} (on the 
boundary = 0} the property (DP) is trivially verified), p, G A[s,T], 
u G Up[s,T], pick po > large enough so that y G Q Po . Note that whenever 
p > po, if P P0 (t Po ) = R, then r = r p = r po and x(t) = x p (i) = x po (t), for 
s < t < t Pq . In particular, x p (9 A r p ) = x(6> A r), for any {^}i> s -stopping 
time 9, where r and r p are defined as in (|4.6|) and (|5.42p respectively. Hence 



E( 8 ,») | ^ A Tp , x p {9 A r p )) - V (6 A r, x(fl A r)) | 

< E (s,y) [l(P P0 (r P0 )=R) \V P ( e A T pi x p (9 A t p )) - V(9 A r, x(0 A r)) |] 

+ E (s,y) [kP PQ (j P0 )^R){\V p {e A r p , x p (6 A r p )) | + \V (9 A r, x(0 A r)) |)] 

< [hP Pa ir P0 )M\ y P ( e A r p , z p (0 A t p )) \ + \V(9Ar, x(9 A r)) |)] 
+ sup \\V p -V\\. 



By Step 3 and in particular (j5.55[) in Theorem 5.1, V p (s,y) converges to 
V(s,y) uniformly for (s,y) G O po , as p — > oo. Hence, we have 



Also, by (|5.54p . for any (s,y) G [0,T] x Q with y = (P s ,£ s ,@ s ), for any 
HeA[s,T],ueUp[s,T], 



Thus setting L(T, C) = exp{(# + ,4C a A^ + £*) 2 g- 2 T}, it follows that 

E {s>y) \V{9AT,x(9Ar))\ 2 
< kN^TL(T,C)E^ y) (e(9 At)) + \b a (1 + K^ y) (P 4 (9 At))) 

+ ^TL 6 (T,C)K (s ^\9At)) 



(s,y)eO, 



•po 



sup_||y p -y|| ->o, p^oo. 

{s,y)£O P0 



(5.75) 



in 




< kN^TL(T,C) f K (s!y) f(t)dt + ^BJl+ f 



Js L x J s 



E {Sty) P\t)dt) 




(5.76) 



2S 



Using arguments as in (|4.15p . the following estimation for the expectation 
of £ 2 holds true: 

E (SiS/) (£ 2 (t)) < exp {{H + AC a N? + tf q- 2 T) := L(T, C). (5.77) 
Together with (|5.52p and (|5.53p . we obtain from (|5.76p that 

' < kN^T 2 L 2 (T.C) + 

(5.78) 



At,i(9 Ar))| 2 < fc^r 2 L 2 (r,C) + - J B4(l+ J B 4 r(l + P s 4 )) 

1, 



+ _ T 2 L 12 (TiC)e 4 > 

Using exactly the same type of arguments, the same bound can be obtained 
for E iSiy) \V p (9 At p ,x(6 Ar p ))| 2 . 

Note that by (|5.5ip . for any e > 0, we can pick po > large enough, 
such that 

^(s,y){P P0 (r P0 ) ^R} = V {S) y){T P0 <r}<e (5.79) 

Combining (|5.75p - (|5.79p and using the Cauchy-Schwarz Inequality, we first 
pick po satisfying (|5.79p then letting p — ► oo in (|5.75p . we conclude that 

lim supE (Si j /) |U p (6» A T p ,x p (6 A t p )) — V(0 A t,x(9 A r)) | =0. (5.80) 

Moreover, for fixed (s,y) G [0,T] x Q/{£ = 0}, fi G A[s,T], it G C^fs.T], 
by (|5.5ip again, we pick p\ large enough so that (|5.5ip holds and y G Q P1 , 
then 



E 



( s >2/) 



6»At 



6>At 



L pi (x pi (t),u(t))dt 



< E 



L(x(t),u(t))dt 
kPpiir^R) I L(x(t),u(t))dt 

Jr Pl 

< (W (s , y) {P Pl (T Pl )^R)}) 1/2 (j s E {S:y) L 2 (x(t),u(t)dt) 

< kN~>e 1/2 ( j E (Sty) £ 2 (t)dt 



1/2 



1/2 



< fcA^ 7 T 1 / 2 L 1 / 2 (T, C)e 1//2 , 
which is independent of the choice of the {^tj^s-stopping time 8. Therefore, 



lim supE 



p— >oo 



0At 



L(x(t),u{t))dt 



0At o 



L p (x p (t),u{t))dt = 0. (5.81) 



Combining (j5.80j) and ()5.8ip . we finally obtain that 

fflAr 



lim sup 



E 



E 



6>At, 



L(x(t),u(t))dt + V{9 A r, a;(0 A r)) 



L p (x p (t),u(t))dt + U p (0 A r p , x p (0 A t„)) 



0. 
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As in the last part of Step 2 of the proof of Theorem 5.1, we conclude 
that the property (DP) holds for the value function V(s,y). The proof is 
complete. □ 

5.3 Existence of Viscosity Solutions 

Now that we have established that the value function is jointly continuous 
and satisfies the Dynamic Programming Principle, it is time to show that 
the it is indeed a viscosity solution of the HJB equation (|5.2p and (|5.3p . 
Recall the notations used in Section 4: 

f(t,x,u) = (b(t,P,u),0,9(t)( H (e(t)), 

a(t,x,u) = (a(t,P,u),- Q - 1 ae + Ac a V /3 -e(t)),a(t)( H (e(t)), 

a(t,x,u) = a(t,x,u)a T (t,x,u), 

L(x,u) = krf 1 ^. 



Theorem 5.3 Under the conditions of Theorem 5.1 and 5.2, the value func- 
tion defined in M-IO ) is a viscosity solution of the HJB equation \5. 2\) with 



the boundary condition \5. 3\) . 

Proof: The boundary condition is clearly satisfied. For any p E C\^{0), 
let V — ip attain a local maximum at (s, y) E O. Fix any u E U, consider 
the constant control u(t) = u, s < t < T, and let 

1 

G(t, x, u, z, B) := —f(t, x,u) • z — -tr(a(t, x, u)B) — L(x, u). 

By the Dynamic Programming Principle, for any reference probability space 
/x E A[s, T], any s' > s with s' — s > 0, small enough, r = r(s, y), 

< %g) [Vjs, y) - pjs, y) - VV A r, x(s' A r)) + p(s' A r, x(s' A r))] 

s' — s 

< 7^ E (s,s/){^ L{t 1 x{t),u)dt-p>{s,y) + p>{s' At,x{s' At)) J. 

Note that from Lemma 4.1, the value function satisfies a polynomial 
growth property. Without loss of generality, we may assume that the test 
function <p also satisfies certain polynomial growth property, namely, 

\<p(s,y)\ < C (l + ||y|| m ), for some m > 1, (5.82) 

where Co > is some constant which is independent of both the time and 
the state variable. Using (|5.52p and the facts that G is a bounded process 
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and t/j is a Girsanov density for which any polynomial moments are finite, 
we see that for any p > 1, 

E^ y) \\x(tW<C p (l + \\y\n, (5.83) 
where C p > is some universal constant depending only on p. Then, 



/s'Ar ^ i f rs'Ar ~\ 

L(t,x(t),u)dtj < - — -kN^E^yJ J £(t)dt \ < oo, 



rs'Ar ~\ i ( rs'Ar 

s' — s 

and thus the Dominated Convergence Theorem ensures that 



1 



s'Ar 



E( S)J/ )| J L(t,x(t),u)dtj — ► L(s,y,u), as s' —>■ s. 
Also, by Ito's formula and the polynomial growth assumption of <f), we have 

■^- s E (s,y) M s ' A r > x ( s ' A r )) - <p(s, y)\ 

1 f f s ' ^ T rs'Ar 

= y^- s E (s>y)\J <Pt(t,x(t))dt + J D x <p(t,x(t))- f(t,x(t),u)dt 

3 r s'Ar 



1 r— f S 

+ 2^2 J D XiXj tp(t,x(t))aij(t,x(t),u)dt 



«J=1 

From (|5.82p and (|5,83p . we first pick p > m, then for any e > 0, there exists 
R > large enough, such that 

P (Siy) { max > R}< R- p C p {l + - s). (5.84) 

te[s,s'] 



Thus, 

1 



s'Ar 

\(f t (t,x(t))\dt 



■y rs'Ar y rs'Ar 

73^ J (max t6 M \\x(t)\\>R) J \Vt\dt+ j—T^^^ \\ x{t )\\<R) J Wt\dt 



1 



s'Ar 



which has finite moment by (|5,83p and (|5.84p . and the Dominated conver- 
gence Theorem ensures that 



1 



s'At 



~ E (s,y) / <p t (t,x(t))dt — ► <pt(s,y), as s' s. 

Js 
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Similarly, we can show that 

-y f m'At ^ 

~T~ E (s,y)\ / DafP(t,x(t)) ■ f(t,x(t),u)dt\ — >D x ip(s,y) ■ f(s,y,u), 



1 



,j _ ; E (s,s/) 



s — s 



1 v— f S 

D XiXj ip(t,x(t))aij(t,x(t),u)dt 

i,j=l Js 

1 3 

— D *iXj l p{s,y)<HA s 'y' u )- 



This lead to 

1 ( r s '^ T 

< p— - E (a>y) | / L(t,x(t),u)dt-ip(s,y) +ip(s' Ar,x(s' At)) 

— ► L(s,y,u) +A u (f>(s,y), 

and therefore 

- ¥>t(s,y) + supG(s,y,u, -tp x {s,y),-ip xx (s,y)) < 0. (5.85) 

On the other hand, assume that V — ip attains a local minimum at (s,y) G O. 
By (|5.59p . for any e > and s' > s with s' — s > small enough, there 
exists fi G A[s,T] and -u G f7 M [s,T] such that 

> E^ y) {V(s,y)-<p( S ,y)-V(s',x(s , )) + cp(s',x(s'))} 

Us' At 
L(z(t),u(i))di+^(s' At,i(s' A r))-^(s,y)}. 

Hence, by arguments as above, we have 

-e < -j—E( s J {-ip t (t,x(t)) + G(t,x(t),u,^p x (t,x(t)),^p xx (t,x(t)))}dt 
s s J s 

-y i-s'At 

< - — E (S)3/ 7 {-ip t (t,x(t))+supG(t,x(t),u,^p x (t,x(t)),^p xx (t,x(t)))}dt 
s —s J s u& u 

— ► ~Vt{s,y) + swpG(s,y,u,-(p x (s,y),-cp xx (s,y)). (5.86) 

Combining (|5.85|) and (|5.86|) . we conclude that V(s, y) is a viscosity solution 
of the H JB equation (|5.2p with boundary condition (|5.3|) . □ 

5.4 Uniqueness of the Viscosity Solution 

In this section, we establish the uniqueness of the viscosity solution of 
(|5.2p and (|5.3p . By Lemma 4.1, the value function satisfies a polynomial 
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growth condition in the state variables. Hence, we will prove a uniqueness 
theorem for those viscosity solutions with polynomial growth. We start with 
introducing the second order sub and superdifferentials with a complete sec- 
ond order expansion in all variables, as given in the User's guide of Crandall, 
Ishii and Lions [7] (see Remark 5.1(h)). Let O be a locally compact subset 
in R A . Let 

USC(0) = {upper semicontinuous functions v : O C M 4 — > M} 
LSC(0) = {lower semicontinuous functions u:Ocl — ► M} 

For x G O, and for v G USC(0), we set 

J^+v{x) = | (p, X) el 4 x5 4 :u(x+/i)-u(x)<p-/i+ix/i-/i+o(||/i|| 2 )j 
= / (D<fi(x), D 2 (f)(x)) : <p €z C 2 , v — <p has a local maximum at xX, 
J 2 ' + v{x) = S^{p,X) £R 4 xS 4 : 3x„G0^x, (p n , X„) G J 2 ' + w(x„) -> (p, X)J , 
and similarly for w G LSC(0), 



J 2 - V (x) = { (p,X) G K X <S : v(x+/i)-u(x)>p-/i+-A7i-h+o 

(D<fi(x), D 2 (f>(x)) : (/> G C 2 , v — 4> has a local minimum at x\, 
T'~v(x) = i (p,I)£l 4 x5 4 : 3x n G0^x, (p n ,X n ) G J 2 '~v(x n ) — > (p, X)l , 



Using the above notations, we state the following Maximum Principle 
for semicontinuous functions. For a proof, see Theorem 3.2 in Crandall, Ishii 
and Lions [7J. 

Theorem 5.4 Let Oi be a locally compact subset ofM. Ni for i = 1, . . . , k, 

O = O x x ••• x O k , 

Vi G USCiPi), and ip G C 2 (0). For x = (x\, ... ,x k ) £ O, set also 

v(x) = ui(sci) H h v k {x k ). 

Let x = (xi, . . . , Xfc) G O be a local maximum of v — ip in O, then for any 
e > 0, there exists Xi G <S * such that 

(D Xi ip(x),Xi) G J 2,+ Vi(xi), fori = l,...,k, 
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and the block diagonal matrix with entries Xi satisfies 

X x ■■■ \ 
: •-. : <A + eA 2 , 
• • • X k ) 

where A = D 2 ip{x) E , N = £* =1 Nj. 

The next theorem is the main result of this subsection. It proves the 
uniqueness of viscosity solutions satisfying a polynomial growth condition, 
of the boundary problem of (|5,2p and (|5.3|) . 



Theorem 5.5 Assume that the conditions (CI) and (C2) are valid. Let W 
and V be respectively any subsolution and supersolution of \5. 2\) with bound- 
ary and terminal condition \5. 3\) , such that for any (t, x), (s, y) E [0, T] x Q 

\W(t,x)\<L (\\x\r+l), \V(s,y)\<L (\\y\\ m + l), (5.87) 

for some Lq > and m > 3. Moreover, for (t,x), (s,y) E d*0, let 

W(t,x) = -PxCi, V(s,y) = -P 2 £ 2 , x = (Pi, 6,60, y = (P 2 , 6, 6 2 ).(5.88) 

Then W(t,x) < V(t,x) for any (t,x) E [0,T] x Q. In particular, 115.2]) and 
\5. 3\) have a unique viscosity solution under a polynomial growth condition. 



Remark 5.2 We assume in the above theorem that both the subsolution and 
the supersolution satisfy the boundary and terminal condition with " = " . 
This avoids appealing to some extra conditions such as uniform continuity 
on boundary and terminal values of the solutions. 

Proof: To prove Theorem 5.4, we argue by contradiction. Suppose there 
exists (io>£o) £ [0, T] x Q and 70 > so that 

W(t ,x ) - V(t ,x ) > 70 > 0. 

Choose r > and 5 > small enough so that 

W(t ,x ) - V(t ,x ) - ^ - 2<5e- T (||xoir +1 + !)>?• (5-89) 

to 1 

(Here without loss of generality, we assume to > 0. Otherwise we can replace 
r/to by r/(T — to) and the argument is similar.) 
Step 1 For e x > 0, e 2 > 0, b > 1, set 

Ht,x,s,y) = W(t,x)-V(s,y)-5e- bt (\\x\r +1 + l)-5e- bs (\\y\\ m+1 + l) 
\\x — y\\ 2 \t — s\ 2 r r 



2ei 2e 2 is' 
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We first show that <I> achieves its maximum in the interior of the region 
([0,T] x Q) 2 . Define 



m 

r]-+0 £— 



lim lim sup \\V(t, x) - V(s, y) - - - - - 5e~ bt (\\x\\ m+1 + 1) 

ry— 0£— I t S 

-5e~ bs (\\y\\ m+1 + l):\t-s\<e, \\x - y\\ < V } , 
m 1 (e 1 ,e 2 ) = sup{$(t, x, s, y) : (t,x), (s,y) G [0,T] x Q}, 

I 1 2 

m 2 (e 2 ) = li mS up(w{t,x)-V{s,y)- l ^^-5e- bt {\\x\\ m+1 + 1), 
77— >0 L 2e 2 

- ,5e- fes (||y|r +1 + 1) - - - - : ||x - y\\ < rj\. 

t s > 

It is easy to see that 

lim mi(ei,e 2 ) = rrizfa), lim m 2 (e 2 ) = Tto- (5.90) 

£l— £2— *0 

Note that for x,y £ Q with ||a;||, ||y|| large enough, $(t,x, s,y) becomes 
negative. On the other hand, (|5.89p guarantees that mi > 7o/2. Therefore $ 
achieves its maximum value in some bounded region. Suppose the maximum 
of $ is attained at (t, x,s,y), and so 

m 1 (e 1 ,e 2 ) = $(i,x,s,y) 

= W(t,x) - V(s,y) - (5e- 6F (||x|| m+1 + 1) - 5 e - b ° (\\y\\ m+1 + 1) 
\\x — y\\ 2 \i — s\ 2 r r 



2ei 2e 2 t s 

< mi(2e 1 ,2e 2 ) 



x — y\\ 2 \t — s\ 2 



4ei 4e 2 
Hence, by (|5.9U|) . we have 

II _ _ , , 2 i — — 12 

lim lim sup ( " X ~ 2/11 + , 1 = 0. (5.91) 

ei-o £2 ^ V 4ei 4e 2 / 

We now claim that < i , s < T and x,y G Q. From the expression of 
<]?, it is easy to see that i > 0, s > 0. Assume that i = T. By (|5.87p . for 
fixed r > 0, 5 > and 6 > satisfying (|5.89|) . we can pick R > such that 
for any < t, s < T, x, y £ Q with ||x|| > R, \\y\\ > R, 

\W(t,x)\ < 5e- bT \\x\\ m+ \ \V{s,y)\ < <5 e - feT ||y|r +1 . 

Hence \\x\\ < R or < R, since otherwise $>(t,x,s,y) would achieve a 
negative value for > R and ||y|| > R, contradicting (|5.89p . Hence 
without loss of generality, we set \\x\\ < R. 

Now since W and V are uniformly continuous on [0, T] x (Qf~\(z G M 3 : 
||x[| < R + 1)), for any < A < r/2(R + 1)T, there exists A > 0, such 
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that whenever (t,x),(s,y) G [0,T] x (Qf](z £ M 3 : ||x|| < R + 1)), with 
|t-«| < A , ||x-y|| < A , 

\W(t, x) - W(s, y)\ < A, |V(t, x) - V(s, y)\ < A. 

If we pick £1, £2 small enough so that |i— s\ < Aq and ||x— y\\ < min{Ao, r/2(R+ 
1)T,1}, then x,y £ (Qf|(2 6 k3 : IMI < R+l)), and so (x = (Pl,£i,Qi), y = 

(i¥,6,e^)), 

|W(t,x)-F(s,y)| < |iy(T,x)-y(r,y)| + |y(r,y)-y(s,y)| 

< |A6-^6I + A 

< (||x|| + ||y||)||x-y|| + A 



Therefore, 



2r 

< — . 
_ T 



W(i,x)-V(s,y)-l- r -<0, 



which again contradicts (|5.89j) . Therefore t < T. Similarly we can show 
that s < T and x,y £ Q. 

Step 2 We now apply Theorem 5.4 to obtain some contradiction. Set 
Ox = 2 = (0,T) x (QniNI < R + 1}), O = Ox x 2 , Zl = (t,x), 
z>i = (s,y), and define 



= W(t, x) = W(t,x) -5e- fe *(||a;|r +1 + 1) 



V(z 2 ) = V(s,y) = V(s,y) + 5e~' bs (\\y\r +1 + l) + -, 

llj; — -jy 1 1 2 U — <,|2 

^1,^2) = <p(t,x,s,y) = — h 



2ei 



2e 2 



The arguments in Step 1 above show that W — V — (p achieves a local 
maximum at (zx,z 2 ) = (t,x,s,y) £ O. By Theorem 5.4, taking k = 2, 
Vx = W, v 2 = —V, and since J 2, V = —J 2,+ (—V), 



D zi (p(zx,z 2 ) = D Z2 ip(zx,z 2 ) 



A = D 2 zV (zx,z 2 ) 



( ^ 



-eo 1 



ft 


y t-s" 


)' 













\ 



















er x /3 


/ 



and we conclude that for e = ex, there exist X, Y € 5 4 such that 



£1 £2 ' 



36 



and 

1 V ° N < A + e.A 2 . 



o -y 

Taking submatrices by omitting the elements of the first and fourth rows 
and columns of the matrices on both sides of the above inequality leads to 

-Y ) ~ TA-h h ) +2£l [ -e?I s efh 

(5.92) 
where we set 

x = I X I\, Y= ( F " Y ? 





' h 


-h 




. -h 


h 


!( 


' h 


-h 




. -h 


h 



X l X J ' \ Yi Y 

with X,Y G S 3 . 

Moreover, we claim that 

LJ,*zl,jf) eS"'* + iy(M), (LJ.izl.y) eB "*-ny). 

In fact, since (j^^Y \x\ G J 2,+ ^(zi), there exists (t n ,x n ) G Oi, 
((?n,Pn),^n) G J 2 ' + W(t n , x n ), such that asn^oo, 

(/x — £ — s \ \ 

where g n G R, p n G R 3 , n G N. Hence for any /i G R, y G R 3 , 

^(t n + /i,x„+y)-^(t„,x n )<g„/i+p„-y+^ n (/ l ,/) T -(/i,y T ) T + o(|/i| 2 + ||y|| 2 ). 

By setting X n = ^ L , we have 

PT(t n + /i,x n + y)-W(t n ,x n )<g n /i+p n -y+^X n y-y + o(|/i| + ||y|| 2 ). 

which implies that (q(n) , p(n) , X n ) G -D( 1,2 ) ,+ W^(i n , x n ). Therefore, taking 
n — > 00, we obtain 

^,^,^Gl? (1 ' 2) ' + W,x). 
£2 £1 / 
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Similarly, we can also prove that ^TT'^J ^ j^ 1 ^' Y(s,y). 

Now by Remark 5.1(i) and the very definitions of W and V, 

' " + ^ 1 (t,x),^^ + D x Mi,x),X + Dl^ 1 (i,x)) eD (1 ^ + W(i,x), 



e 2 dt 
t-s d 



e 2 dt 



£1 



£1 



where </?i(t,x) = e)e 6t (||x|| m+1 + 1) +r/t and ip 2 (s,y) = 5e 
1) + r/s. Hence, ((EZJ) and ([S3]) yield 

t-s a 



6snu,ii"i+i 



+ 



- — yji (t, x) +ft (t, x, ?—V +Dx(pi ( t) S ) , X+D^ ( / ..(•)) £ ( )( •-).<>:{ ) 



£2 dt' \ £1 

Subtracting (|5.94p from (|5.93p gives 



D w¥>2 (f,y),y-£>^(l,i/) > 0^.5.94) 



H(t,x,pi(t,x),Bi(t,x)) -H(s,y,p 2 (s,y),B 2 (s,y)) +bSe 



6f (||x|| m+1 



+ 1) 



+6<5e- bs (||y|| m+i + 1) 
r r It 

where 

pi(t,x) = - — - + D x (pi(i,x) , p 2 (s,y) = - — - - D y (f 2 (s,y), 
£1 £1 

B l (t,x) = X + D 2 x ip l (i,x) , B 2 (s,y) = Y-D 2 y <p 2 (s,y). 
Now for fixed u £ W, we obtain 

G(i, x, u,pi(i, x), B x {i, sc)) - G(s, y, u,p 2 (s, y), S 2 (a, y)) 
f(i,x,u) -pi(i,x) - -tr(a(t,x,u)B 1 (i,x)) - L(x,u) 

- f(s, y, u) ■ p 2 {s, y) - -tr(a(s, y, u)B 2 (s, y)) - L(y, u) 
> -\f(i,x,u) -pi(i,x) - f(s,y,u) -p 2 {s,y)\ - \L(x,u) - L(y,u)\ 



(5.95) 



- - tr(a(t, x, u)Bi(t, x) - a{s, y, u)B 2 (s, y)) 
= -h-I 2 -h. 
By the conditions (CI) and (C2), 



I\ < sup 

u<3U 



(f(t,x,u)-f(s,y,u)) ■ 



x-y 



£1 



+ 5 (m +l)\\x\\ m - 1 sup \f(t,x,u) >x\ 
ueu 



+ 5(m + l)\\y\\ m - L sup\f(s,y,u) ■ y\ 
^l\+5L(l + \\x\r +1 + \\y 



O 



m+h 
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where L is a universal constant independent of b and 8, and 

h<k?H\\x-y\\. 

For ^3, using (|5.92p (with the control variable u is omitted for simplicity), 



tr 



3 

< — tr 



a(t,x)a T (t,x) a(t,x)a T (s,y) 
v{s,y)cr T {i,x) a(s,y)a T (s,y) 

a(i,x)a T (i,x) a(i,x)a T (s,y) 
o-(s,y)a T (i,x) a(s,y)a T (s,y) 



X 0^ 
-Y 



h ~h 
-h h 



which implies that 



tr(a(t,x)X-a{s,y)Y) < -tr((a(t, x)-a(s,y))(a T (i, x)-a T (s,y))) . 



Also, for r > 0, 5 > and b > satisfying 



, using arguments as at the 



end of Step 1 above, we can pick R > so that <3?(i, x, s, y) is negative when 
both ||x|| > R and ||y|| > R, Then we can choose E\ > and £2 > small 
enough so that ||x|| < R+ 1 and ||y|| < R + 1. Together with the conditions 
(C1)-(C3) and the uniform continuity of a in [0,T] x (Qn {||z|| < R+ 1}), 
we have 



1 r 



tr((a(t, x, u)-a(s, y, u))(a T (t, x, u)-a T (s, y, u))) 



1 r 



+ 2 
1 

2 

1 

+ 2 
1 



l r 



tr(a(t,x,u)D x if 1 (t,x)) + -\tr(a(s,y,u)D y ip(s,y)) 



+ 



+ 



+ 



tr((a(i, x, u)-a(i, y, u))(a T (i, x, u) -a T (i, y, u))) 
tr((cr(i, x, u)-a(i, y, u))(a T (i, y, u)-a T (s, y, u))) 
tr((a(i, y, u)-a(s, y, u))(a T (i, x, u)-a T (i, y, u))) 



2 L 



tr{(<r(t, y, u)-a(s,y, u))(a T (t, y, u) 

1 



-a (s 



tr(a(t,x,u)Dl(p 1 (t,x)) +- tr(a(s,y,u)D 2 ip(s,y)) 



< 0(\\x -y\\ 2 ) + 0(\t-x\ 2 ) +8K(1 + \\x 



im+l 



+ 



where K > is independent of b and 5. Hence 

G(i,x,pi(t,x),Bi(i,x) - G(s,y,p 2 (s,y),B 2 (s,y)) 



> 



-S(L+k)(l+\\x 



\rrb\-l 



+ 



)+0 (\t-s\ 2 )+0(\\x-yf)+0 



and thus 

H(i,x,pi(i,x),Bi{i,x) - H{s , y , p 2 (s , y) , B 2 (s , y)) 
> _^ + ^)(l + ||x||- + - 1 + ||y||- t - 1 )+0(|t-s| 2 )+0(||S-y|| 2 )+0 



\x-yf 
£1 



f \\x-yf 
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Therefore, (|5.95p now becomes, 

- ( 5(Z+^)(l + ||x||^ 1 + ||^||^ 1 )+0(||x-y|| 2 )+0^ l|x ~^ 2 ^ + 0(\t- s\ 2 ) 

- 2r 

+ b6e- bt (\\x\\ m+1 + 1) + b5e- bs (\\y\\ m+1 + 1) < (5.96) 

T z 

Note that in (|5,96|) , if we choose b > 1 large enough so that 
65e- 6 *(]|S[|^ 1 H-l)H-fo<ye^^(||^]|^ 1 + l) — ^(Zh-^)(1 + [l^ll^ 1 ^]!^!!"^ 1 ) > 0, 
then ()5.96p implies that 

0(||x-y|| 2 )+o(fc^) +0(|t-,-| 2 ) < (5.97) 
Therefore, by taking £2^0 and then e\ — > 0, we finally obtain 

= limsup f limsup((0(||x-y|| 2 )+of ^~^ H | < 



£1^0 \ £2^0 



which is clearly a contradiction. The proof is now complete. 
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